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SUMMARY 


There 1s frequent need to obtain information as to the attrioutes, charactenstics, reliabilities, 
and capabilities of production items. Such information 1s required for logistic planning, tactical 
operations, and alternative uses and to determine that the supplier has met contractual specifica- 
tions. The normal procedure involves the testing of a number of items that have been randomly 


chosen from a production lot. 


In one type of acceptance sample testing, it 1s assumed that each item will be either a suc- 
cess or a failure, and no allowaace 1s made for varying degrees of success. Upon completion of 
the testing, 1t 1s desired to determine, at a certain level of confidence, limits on the reliabslity 
of the entire !ot from which the sample was selected. 


Graphs are given here that may be used to determine esther one-sided or two-sided reliability 
limits at any desired confioence level, based on the success ratio for the tested items. The sam- 
ple 1s assumed iv have been drawn from a population with unknown reliabilbty p (percentage of 
good items). The graphs are for sample sizes from 1 to 100 and also from 100 to 1,000 1n multiples 


of 16. 


Two basic assumptions are possible in random sample testing: that of the binomial cistribu- 
tion and that of the hypergeometric distribution. The theory and the graphs of this report are based 
upon the binomial distributicn. Tie binomial distribution 1s usually sufficiently accurate, but 
formulas for approximating the hypergeometric distribution from the binomial distribution values 


are given in the appendix. 
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INTRODUCTION 


A common contract provision for acceptance of production items is a given probability of suc- 
cessful performance under specified conditions. An associated confidence level is usually either 
inplied or stated. An accepted factor in any estimate of the quality of the produced item is this 
performance probability, often called reliability. 


In 100-percent testing, how many units passed and now many failed is known, and thus the 
reliability is known. In sample testing, only the success and failure ratios for that sample and 
that test are known. This success ratio for a given test is the best estimate of the probability of 
successful performance on that test of an individual item of the remainder of the group of items. 
The probability of a randomly selected iter: of the untested items passing 07 failing the test 1s 
between 0 and 1, but any value between these limits has an associated upper and lower confidence 
level based on the sample test results. Correspondingly, for a given confidence level, there is an 
associated one-sided or two-sided popul ation reliability limit. The definition of these confidence 
leveis, as used here, together with their adequacy, is discussed ix the section entitled ‘‘Theory.”’ 


This regort presents graphs of the entire spectrum of confidence levels and the associated 
reliabilities determined by the sample testing results. The graphs are based on the binom‘al dis- 
tribution theory. There are 190 graphs given, one for each sample size from 1 to 100, and trom 
100 to 1,000 in multiples of 10. 


From these grapas and the actual number of successes, upper reliability bounds and associ- 
ated confidence levels, and lower reliability bounds and associated confidence levels can be read. 
Reliabitity intervals for given ievels of confidence can also be read. Conversely, the number of 
successes required for a particular sample to meet a stcted reliability at ststed confidence levels 
cais be determined. The graphs can also be used to determine whether the sample falls within pre- 
determined risk levels. 


The binomial distribution theory assumes that the reliability of the items in the population 
remains unchanged as the sample is selected. For a finite population or a nonreplacement sam- 
pling plan, the exact theory is that of the hypergeometric distribution. Since the population size 
is usually large compared to the sample size, the binomial result is a good approximation to the 
hypergeometric. Hypergeometric distribution tables are given in reference 1. Formulas for ap- 
proximating the hypergeometric distribution from binomial distribution values ere discussed in the 
appendix. 


SYMBOLS 

a Sample size 

8 Nuwhber of items in a sample the ss a given test 
p Population reliability 

Pe Lower reliability limit 

Ce (py; 8,0) Confidence level thet p > py, given s and n 

Pu Upper reliability limit 

C.@,,; *.a) Confidence level that p< p,, given s and 


1 - Copy: 8,4) Risk that p < py 
1~-C (@,; 3,9) Risk that p > p, 
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THEORY 


Consider the determination of an unknown population reliability p, based on the testing of a 
sempie of n items randomly drawn from the population. The probability (j) of obtaining exactly 
j successes within the n items tested is given by the binomial distribution 


j) =< —A! pri - py 8-3 bn 
oj ™a 2p p’(1 - p) ( 
s-l 
The probability of obt>ining at most s - 1 successes in the sample of n is Yeo. This 
j=0 


probability is used by many authors as the definition of the confidence level that the reliability is 
at least pp, given s and n (see references 2 and 3); that is, 


Cole; 8,9) = Sow =1- Yeo (2) 
3=0 


It should be noted that, because of the discrete nature of the distribution, the probability that the 
reliability is at least py is, in general, greater than Cp{py; s,m). This is also pointed out in ref- 


erence 3. In other words, the definition used for the level of confidence is conservative, and 1s 
most conservative when the size of the sample is smali. 


Conversely, the confidence level that the reliability is at most p,, given s and n, is defined 
by 


C..@,; 8.9) = > $4) = 1- Sse (3) 


j=etl j=0 


Agaia, Ce a’ 32) is conservative. 


Note that, fe: s = 0, Cqlog; s,n) = 0 for any Pe greater than 0. For s =a, C0: s,n) = 0 for 
any p,, less than 1. Note also that, if p, = pp, C,(p,; 8 - 1,n\ = 1 ~ Copp; 8,0). This fact makes 
it possible to combine graphs for py and p,. 


THE GRAPHS 


The graphs are given in figvres 1 through 190. A separate graph is given for each sample size, 
n, from 1 to 100 and from 100 to 1,000 in multiples of 10. The vertical scale en the left side of 
each graph is for Cy(py; 8,2) and that on the right side is for C (p,; s,n). The graphs for n from 


1 to 50 give separate curves for all possible number of successes, s, from 1 to n for py, and from 
Oto n-1 for Py: For n > 50, the values of s for which curves are actually plotted are eatered 


on the apg -opriate carves. These values were chosen so that linear interpolation in the horizontal 
direction will give three-decimal accuracy. in most cases, if the graphs are plotted and read pre- 
cisely, the error in linear interpolation in the horizontal direction will be considersbly less than 
0.001. 
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EXAMPLES 


For the following examples, assume that n= 10 and s = 5. Ther. the graph of figure 10 is 
used, the fifth curve being used for pp and the sixth curve for p,. 


Example 1 
Determine a 90-percent confidence interval for the population reliability. 


In general, to determine the C% confidence level (two-sided symmetric interval) use 
C. = (1 + C)’2 to determine Py, and Cy = (1 + C)/2 to determine Pp- ““he reliability interval for 


the C% confidence level is then 
PPS PSP, 


For this problem, 


Cp kee = 0.95 


and 


c= 1409 - 0.95 


Then from the graph of figure 10, py is determined to be (.22, and p, is determined 


to be 0.78. Thus at the 90-percent confidence level. the required reliability interval is given by 
0.22 << p< 0.78. 


Example 2 
For 
Cp. 5,10) = 9.8, pp = 0.33 
For 
C.@,; 5,10) = 0.8, p, © 0.675 
Thus for a 60-percent confiderce interval, 
0.33 < p < 0.675 
Example 3 
For 
Copy; 5,10) = 0.9, pp = 0.265 
For 


Cy(p,; 5,10) = 0.9, p, = 0.735 


ws. cin FeV ares tae NEARER MUST 
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0.265 < p ~ 0.735 


NUMERICAL ANALYSIS 


For computational purposes, using equation (1), it is convenient to write equation (2) in the 


| 

| Thus for an 80-percent confidence interval, 
t 
{ 


form 
(Gr: 8.0) = 2. [- x*-! (1 ~ xy9-* dx (4) 
sa a a meer oa F 
ry t 
i Then 
OC e (pp; 5.0) a: a! 8-17, _ 9. \n-8 5 
ep eee 2 
and 
2 _B- 1) 
PCy (0Y: s.n) Pape Cy (Py: 3,0) x . D(Pr n-1 (6) 
dp? Ope pe (l - pp) 


For 0 < pg < 1, the only point of inflection is at pz = (8 - 1)/(n - 1). Equations (1), (2), end 
(5) in logarithmic form were used to evaluate Cp(py; s,n) and [OCp (pg; 8,0)]/(Apg) at pp = (8 - 1)/ 
(n - 2). 


For (8 - 1)/(n - 1) < pg < 1, Cy(pe; 8,0) was evaluated by numerical integration. The formula 
i that was used is 


Colo + bs 8.0) = Copy: 8.0) 
vy Rtnoten , tg 
2 of ore 


eae +h s a) PCr OH: =| 
sy 


ap Pp 
e | The first derivative was calculated by the equation (derived from equation (5)) 
- OC (y: 8.0) s.n) Het 5 #,0) aa ae p;, \"* 
. ae a t, 1- Pe, . 


The second derivative was calculated by equation (6). 


6 


: 
| 
| 
| 


RE pe ee gee ie reer epee mae 
oe 


For 0 < pp < (s - 1)/(n ~ 1), Cptpg; s.n) was calculated by the equation (derived from equa- 
tions (1) and (2)) 


Co(py; s,n)=1- orze! - Pp, n+ 1 - s,n) 


Fer s = 1, Cp(pe; 1,n) was calculated by the equation (denved from equations (1) and (2)) 
PPE 


Co(py: 1.n) =(1 - pe)” 
An estimate of the error in the method can be obtained at py = 1, since 
Cp(1; s.n) = 0 


The maximum deviation of the calculated value of Cr(1; s.n° from 0 was less than 2 107°. 
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Figure 80. Reliability Curves for n = 80. 
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APPENDIX 
CONVERSION FROM BINOMIAL TO HYPERGEOMETRIC DISTRIBUTION 


Reference 1, page 19, gives formulas for approximating the hypergeomeiric distribution if 
results for the binomial distribution (such as the graphs of the present report) are given. 


Let 
N = lot size 
n = Sample size 
i xa 
s = number of ‘‘successful’’ items in sample 


Ce(pp. S.n) = confidence level 
Pr, = lower reliability for the binomial distribution (provided by the graphs) 
Pe = lower reliability for the hypergeometnc distribution 


Then, from refererce 1, 


1 1 5 
= — |Mpp + =(s-)) - 
PE 5 (Mee, 2S") ~ Fay 
where 
m-n-1, i 
2 2 
ana 
> 1 2 1 \.2 
6 = eee eas *(r me) 
1- tf) (0) 
\ Peo Pee 
+ (2P¢ -1) Ue-@-s)-1)- 2 - 4h 
9 Pe, vw Pl 


As an example, consider N = 25, n = 20, s = 13, and Ce(pp; s,n) = 0.7. From figure 20, 
Pp = 0.565. Then 


: 1 ‘ re 1 1 1 
. {—L_ - 9.435) (64) - (0.565 - 169) = (0.13) (63) - —L_ - LL 
7 ( 2) e) ( = stax) ¢ ) + (0.13) (3) - See Tass 


and 


pak [cas.s) (0.565) = 6 - opie = 0.598 


If 6 1s taken as zero, calculations give pg = 0.590. From the tables of reference 1, the true value 
of pp 1s 0.600. 
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Again, consider N25, n 10, 5 - 8. and Cyp(py, s.n) - 0.6. From figure 10. pp = 0.705. 
Then 0 


3 (4b : 0 298) (9) - (0.705 Saal ) (oa) L $0 G1iSs ell 
0 295 0.705 0.705 0.295 


and 


1 ee a ee 
Pre a [o.s) (0.708) - 3. - anaes | - 0.719 


canes semen nee SO AN REE CREST LEE STS TER LIF ATER 


If 5 is taken as zero, calculations give Pp = 6.718. From the tabies of reference 1, the true value 
of pp is 0.720. 


According to reference 1, 5 can usually be taken as zero ifn < 0.4N. 


The corresponding formula fo: p, is 


~ 1 1 6 
re h(a Ee a 


and 


+ (2p, -2) sa-s-1)-1) -- - —_L.. 
0 Puy 


Consider N = 25, n = 20, s = 14, and C,(p,; s,n) - 0.78. Figure 20 gives Puy, z 0.792. Then 


$e (sas 3 0.208) (36) - (0.792 - 
0.208 


) (225) - (0.584) (69) - tik 


1 
0.792 0.792 0 208 


and 
p.  — 1(15.5) (0.792) -7 - —9___] = 0 761 
vu 35 (24)(15.5) 


If 5 is taken as zero, calculations give p,, = 0.771. From the tables of reference 1, the tue value 
of p,, is 0.760. 


Again, consider N = 25, n = 10, s = 6, and C.(p,; sn} = 0.74. Figure 10 gives Puy = 0.735. 
Then 


ee eae om - 0.265) 16) - (0.735 - —! ) «9 {OAD OI ws tes 
(a8 ue ( 6755) 19) + CAND + oe Gs 


SETS ETI FT EEE. re a 


and 


! 2 ocd 3 ate 
ce -L {(205) (0 735) - 3 - —§ _|- 0720 
mle (24) (20 =| ‘ 


If 6 1s taken as zero, calculations give P,, = 9723 From the tables of reference 1, the tme value 
of Pp, #89 720. 
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